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Abstract — To evaluate the performance of the code, it is indispensable to know how to calculate the 
probability of error in decoding. The weight distribution and the enumerator polynomial input-output of the 
code are very useful in studying the probability of error that occurs when using a maximum likelihood 
decoding. In this paper, we are interested the performances of turbo-code 3 dimensional (TC-3D) when it is 
decoded on optimizing criterion the maximum likelihood. First, we determine the mean weight distribution and 
the enumerator polynomial input-output of this code, which provides an upper bound on its minimum distance. 
Then we deduce from this distribution the bound probability of error by bit and by word on the Gaussian 
channel. 
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I. Introduction 

MODERN wireless communication standards have 
already adopted various types of codes for channel 
coding applications. For example, the Turbo codes 
are used in the 3 GPP Universal Mobile Telecommunications 
System (UMTS) [3GPP UMTS, 2007], Long Term Evolution 
(LTE) [3GPP LTE, 2008], Digital Video Broadcasting 
standard [ESTI, 2000] and the 802.16a WiMAX standard for 
local and metropolitan area networks [IEEE, 2003]. 
Furthermore, these codes are currently being proposed for 
next generation cellular and mobile broadband systems. 

In 1993, the invention of turbo codes by Berrou et al, 
(1993) provided a new looks at on the existence of realistic 
codes approaching the limits given by information theory. 
The turbo-codes are based on the parallel concatenation of 
elementary codes linked by a random interleaver. Despite a 
relatively small minimum distance, their performances are 
separated by only 0.5 dB performance limits proposed by 
Shannon. In other words, although these codes are bad codes 
point to the usual criteria of coding theory i.e. the ratio of 
their minimum distance to their length tends to zero as it 
tends to infinity. They achieve performance very similar 
optimal. Distribution of this minimum distance, present the 
similarities with the distance distribution of a random code, 
which appears as an exploitation of their excellent 
performance [Battail, 1997]. 



In the future, most of digital transmission systems 
require low error rates which can go up to 10 -8 dB [Berrou et 
al, 2007]. Improving performance at very low error rates by 
raising the minimum hamming distance may involve at least 
one of these items: 

• using component encoders with a larger number of 
states, 

• devising more appropriate internal permutations, 

• or increasing the dimension of the turbo code, i.e. the 
number of component encoders [Eirik Rosnes & 
Alexandre Graell i Amat, 201 1]. 

In this work, we are interested in the third case, i.e., 
increasing the dimension of the turbo code. 

In this paper we propose a new tree dimensional Turbo 
code which aims to improve probability of errors. The TC-3D 
we describe here is inspired from classical turbo code (TC- 
2D) by adding a third dimension. To evaluate the 
performance of this code, it is necessary to determine the 
average weight distribution and the enumerator polynomial 
input-output. So we may compute the upper bound of TC-3D 
minimum distance and deduce from this distribution the 
bound probability of error by bit and by word in the Gaussian 
channel. The provided results are compared to TC-2D. 

The paper is structured as follows. Section II gives a 
short introduction to turbo codes with 2 dimensions and 
presents the structure of the encoding and the decoding of 
TC-3D. In section III presents the average weight distribution 
of TC-3D. In section IV, we present the polynomial input- 
output of this code. Section V analyzes the upper bound of 
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the minimum distance of the code TC-3D. The probability of 
errors by word and bit on a Gaussian channel are described in 
Section VI. The paper is summarized in the section VII. 

II. Coding Structure of Turbo Code 
with 3 Dimensions 

Generally, a Turbo code with 2 dimensions is composed of a 
concatenation a series [Eirik Rosnes & Alexandre Graell i 
Amat, 2011] or in parallel of two codes (C 1 ,C 2 ), that is called 
code components, and an interleaver n (see figure 1). While 
the first code component encodes the information in the 
original order, the second receives the information in a 
permuted order. In all norms, the convolutional codes are 
used as component codes. For more information about TC- 
2D and TC-S, refer to [Benedetto & Montorsi, 1996]. 
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Figure 1 - Structure of Parallel Turbo Codes with 2 Dimensions 

2.1. The Coding Structure ofTC-3D 

Figure 2 shows TC-3D using the three components codes 
C 1 ,C 2 and C 3 in parallel that will be used throughout this 
article to illustrate some fundamental concepts. The three 
codes are recursive convolutional in nature [Hagenauer & 
Hoeher, 1994], with a constraint length L = 3 (i.e. memory= 
2 ). The overall code is a rate to equal 1/4 code with four 
output streams. One of the output streams is the information 
sequence u uncoded. The other three output streams X lt X 2 
and X 3 in this example are parity sequences corresponding to 
three codes C 1 ,C 2 and C 3 . These three parity streams would 
be identical if permutations ttI, tt2 were not used. 
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Figure 2 - TC-3D constitute from Three Codes Q , C 2 and C 3 which 
are grouped in Parallels 
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The sequence u information of length K bits is encoded 
by TC-3D. This code is realized by the parallel concatenation 
of three identical coders: C x = C 2 = C 3 . They are recursive 
convolutional in nature, with 8 states and the generator 
polynomial is: 

Gl = [1 1 1] 
G2 = [1 1] 

The information bits u are encoded initially by the 
encoder C x to provide the first redundancy bits X 1? then they 
are interleaved by ttI before being encoded by the encoder 
C 2 and delivering the second redundancy X 2 . The message u 
is then interleaved by tt2 before being encoded by the 
encoder C 3 and delivering the third redundancy X 3 . 

For the canal entrance, we send a message u and data 
redundancy X 1 ,X 2 and X 3 generate with three elementary 
codes C 1? C 2 and C 3 . The originality of the encoder is 
performing an interleaving (tt1;tt2) on the data u before 
treatment C 2 and C 3 encoders so that errors are not corrected 
by the first encoder will generally be different the errors not 
corrected by the second and third codes. 

Finally, the information sequence u and the code 
sequences X 1? X 2 and X 3 are multiplexed to form the 
codeword u ch of length N bits, they are transmitted to the 
channel. Note that the total code rate of the TC-3D is 
R = K/N , then we can write : 

u ch = (uX 1 X 2 X 3 ) (1) 

2.2. Decoding of TC-3D Code 

In the AWGN channel, the binary information sequence 
u ch =(uX 1 X 2 X 3 ) N-dimensional bits as input to the 
channel, produces a sequence u ch = (u'X^ X' 2 X' 3 ) the N 
dimensional bits, the relationship between u ch andu ch for 
the AWGN channel is: 

u ch' =u ch + B (2 ) 

Where B is a random sequence representing the "noise" or 
"error" additive 
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Figure 3 - Schema of TC-3D Decoder 
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The TC-3D can be decoded using the turbo principle. 
The decoder of TC-3D consists of three soft-input soft-output 
[Yannick Saouter, 2010] decoders Cf 1 , Cj 1 , and C^ 1 
corresponding to the three constituent encoders C l5 C 2 , and 
C 3 , respectively. A decoding iteration consists of a single 
activation of Cf 1 , Cj 1 , and Cj 1 , in this order. This process 
continues iteratively until the maximum number of iterations 
is reached or an early stopping rule criterion is fulfilled. 

These three decoders exchange extrinsic information 
[Battail, 1997] on the systematic bits u' and the parity bits 
X a ',X b ' and X c This extrinsic information exchange is 
referred as turbo principle. Figure 3 shows a possible decoder 
realization. 

The three component decoders perform a maximum a 
posteriori probability (MAP) decoding on bit. They use the 
BCJR algorithm transformed in the logarithmic domain, the 
so called Log MAP algorithm [Robertson et al, 1995], to 
decrease the implementation complexity. 

III. Average Weight Distribution 

Let A^oo) be the number of code words average of C x and 
the weight 0). The average weight distribution of TC-3D is 
denoted C, is obtained by averaging over all random 
inter leavers Tq , i = 1,2 of length N. 

Let P(o)) be the probability that a sequence of weight 0) 
is a code word C the weight oo, and A(o)) the total number of 
code words the code C of weight 0). There exists CfJ words 
the weight 0) and the length N, so we have the following 
relationship: 

A(a>) = C$P(a>) with C$ =^^ (3) 

Let ? 1 (a)), P 2 (oo) and P 3 (oo) be the probability that a 
sequence of weights co is a codeword C x , C 2 , C 3 respectively. 
The codes C 2 and C 3 being permuted versions of the code C 1? 
probabilities P 1 (o)) ; P 2 (o)) andP 3 (o)) are identical and equal 
to ? 1 (a)), so the probability P (co) can be written: 

pM = PiMxp 2 Mxp 3 (6)) (4) 

Of over: 

A 1 (o)) = CftP 1 (a)) (5) 

The mean distribution of the weight of TC-3D code is 
given by the following relationship: 

A(ojJ= 



(C%) 2 



(6) 



Weight distribution A 1 (00) of C± convolutional code can 
be calculated using the transition matrix T raised to the power 
W, where W is the number of branches in the trellis code 
[Divsalar et al, 1995]. 

The previous formula was applied to a code of length 

N = 200 constructed from two recursive systematic codes 

(RSC) of rate 1/2 and generator polynomial Gl and G2, for 

calculate the weight distribution A(co): 

Gl = [1 1 1] 

G2 = [1 1] 





Table 1 


- Average Weight Distribution of TC-3D 
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This weight distribution is compared to turbo code with 
two dimensions for N=200 in Figure 4. The two distributions 
are shown in Figure 4. 
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Figure 4 - Comparison of Weight Distribution TC-3D Code and the 
Weight Distribution of a Turbo Code in Two Dimensions for N=200 

IV. Polynom Enumerator Input-Output 
of TC-3D 

To simplify the study, we assume throughout this sub- 
paragraph the three coders C^ , C 2 and C 3 are RSC and 
identical i.e. C^ = C 2 = C 3 . Their rate is R x = R 2 = 
R 3 =1/2. The rate of the resulting TC-3D is equal to R=l/4. 
Trellis termination is neglected, and we denote by N^ the size 
of the interleaver. The enumerator polynomial input-output 



code C x wrote: 



AHI,Z)= ^ ^ 



A C > P Z z 



(7) 



Where A i \ is the number of codewords C x corresponding 
to a weight of information i and the weight parity z. The 
polynomial A Cl (I, Z) does not include the word 0, ..., 0. For a 
RSC code which trellis is closed, the minimum weight input 
is imin • The minimum weight output z min does not 
necessarily correspond to minimum weight input i min ; if we 
note z min the weight of the parity corresponding to the weight 
input i min , then in general: 

7 *C Z 

The polynomial A Cl (I, Z) can also be written as follows: 
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With 



A c iQ,Z)= V I 1 A c ^(i,Z) 

l=l min 

A c i(i,Z)= £ A%Z Z 



(8) 



(9) 



Where A Cl (i, Z) is called conditional weight enumerator 
polynomial because the weight of the input i is fixed. A 
method for calculating this polynomial is presented in 
Benedetto & G. Montorsl (1996) and Battail (1997). 

The conditional weight enumerator polynomial 
conditional TC-3D considered is calculated by averaging 
over all possible interleavers. The interleaver TC-3D is 
random; three encoders' inputs are independent. Therefore it 
is easily verified: 

(A^(i,Z)f 



A c (i,Z)=- 



i \2 



(a) 



(10) 



V. Superior Bound of the Minimum 
Distance of TC-3D Code 

The average weight distribution of TC-3D code provides an 
upper bound p of its minimum distance d H min for a length 
code N fixed. In fact, 

Pr(d Hmin < p) = Pr(B v E (GF(2)) N , 
o) v < p, ve C) 

Where 0) v denotes the weight of the sequence v. The terminal 
of the union applied to this equality gives: 



(11) 



Pr(d Hmin <p)<Y j Pr{3v 

£ = 1 



(12) 



G (GF(2)) N ,veC,a) v = i) 
But there are M = C^ the sequences of weight i in 
(GF(2)) N denoted s 1; ...,s M thus: 



Pr(d H min < p) < 2^ Pr((s t € C, a) sl 

£=1 



(13) 
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(14) 



p)< 2^2^ Pr ( s j eC ' ^ = ^ 

The probability Pr(s ] e C, 0) S] = i) is by definition to 
equal to the probability P(i),V j, hence: 



Pr(d Hmin <p)<^MP(i) 

P 

£ = 1 

P 

<^A(i) 



(15) 
(16) 

(17) 



Consequently, an upper bound is given by p, the smallest 
integer satisfying: 



I 

W — l 



A(co) = 1 



(18) 



Table 2 - Presents some Values of p for the TC-3D Code for 
Different Length N 



Length N 


Superior Bound p 
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36,840 


200 


46,416 


300 


53,133 


400 


58,480 


500 


62,996 


600 


66,943 


700 


70,473 


800 


73,681 



Figure 5 represents evolution the superior bound p of the 
minimum distance for lengths codes from N=100 to N=800, 
total rate R = 1/4 and pseudo-random interleaving, in the 
three following cases: 

• TC-3D 

• Parallel Turbo code with 2 dimension (TC-2D) 

• Serial Turbo Code ( TC-S) 
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Figure 5 - Evolution the Superior Bound p of Minimum Distance 

More than the same values of the superior bound p, it is 
interesting to note on this figure, the nature of the evolution 
of p as a function of N. Indeed, in the case of TC-3D this 
evolution is higher than the turbo-code parallel and serial 
with 2 dimensions. For the turbo code with two dimensions, 
distance varies very little as a function the length N of the 
code. This behavior is similar to the results of the minimum 
distance presented by Kahale & Urbanke (1998). 

VI. Probability of Error on the 
Gaussian Channel 

The average weight distribution of the TC-3D code can also 
enable us to deduce bounds for the error probability of this 
code on the AWGN channel. Indeed, the interleavers in TC- 
3D code act on all the bits coded such that all bits coded are 
equally protected. The probability of error by word Pe w and 
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bit Pe b are then obtained by applying the bound of the union 
and increased by: 



Pe w < ^ A(o))q{ Iro)- 
co=d 1 yl 



^X>-)c [ h 2 -it 



(19) 



(20) 



Where E h /N is signal-to-noise ratio average by bit and Q (x) 
denotes the error function. Figure 6 shows the probability of 
error by bit obtained after decoding the code TC-3D, the rate 
R =1/4 constructed from convolutional code for K=1024 bits, 
K=3072 bits and K=6148 bits. 




Figure 6 - Probability of Error by Bit for K=1024 bits, K=3072 bits 
and K=6148 bits 

Let us note that bounds more precise at low signal-to- 
noise ratios can be considered to estimate the probability of 
error by word and bit. 

VII. Conclusion 

To estimate the performance of a code, it is necessary to have 
information on its minimum distance and the probability of 
error. The weight distribution and enumerator polynomial of 
the code are very useful for studying these performances. In 
this paper we have calculated the weight distribution and 
enumerator polynomial input-output of TC-3D to evaluate 
their minimum distance and their error probability. The 
results found are compared to the turbo-code with 2 
dimensions. We deduce from these results (Figure 4 and 
Figure 5) that the performances of TC-3D are better than 
those of the turbo-code with 2 dimensions. In the future work, 
we will study the relationship between the inputs and the 
outputs of our code, i.e. the transfer function. 
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